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Aachen University 

Fudenberg and Harris’ stochastic version of the classical repli¬ 
cator dynamics is considered. The behavior of this diffusion process 
in the presence of an evolutionarily stable strategy is investigated. 

Moreover, extinction of dominated strategies and stochastic stability 
of strict Nash equilibria are studied. The general results are illus¬ 
trated in connection with a discrete war of attrition. A persistence 
result for the maximum effort strategy is obtained and an explicit 
expression for the evolutionarily stable strategy is derived. 

1. Introduction. The deterministic replicator dynamics is one of the 
most widely used dynamical models to describe the evolution of a pop¬ 
ulation under selection. The evolution is governed by a symmetric two- 
player game with n pure strategies, l,...,n. Let ajk denote the pay-off 
to a player using strategy j against an opponent playing strategy k. Let 
A = (ajk). Suppose that every individual of the population is programmed 
to play one fixed pure strategy. For every point of time t > 0, let Q (t) de¬ 
note the size of the subpopulation whose individuals play strategy j. and 

let £j(t) = Cj(t)/[C\ (t) H-hCn(i)] denote the proportion of j-players in the 

population. If the population state is £(i) = (£i(t),... ,Cn{t )) T , then {A£(t)}j 
is the average pay-off to individuals playing j, when individuals are paired 
at random. Suppose that the pay-off represents the increase of fitness, mea¬ 
sured as the number of offspring per unit of time. Then 

(1.1) ^l = C j (*){A{(t)} j , j = l,...,n, 

and so 

(1.2) = i = 1. n. 
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This is the deterministic replicator dynamics of Taylor and Jonker (1978). 
See Hofbauer and Sigmund (1998) and Nowak and Sigmund (2004) for de¬ 
tailed discussions from a biological point of view and Weibull (1995) for a 
description in an economic context. See also Hofbauer and Sigmund (2003) 
for an extensive survey of deterministic evolutionary game dynamics. 

Recently, models of evolutionary dynamics which incorporate stochastic 
effects have attracted substantial interest. The seminal paper of Foster and 
Young (1990) seems to be the first that presents a continuous-time replica¬ 
tor model based on a stochastic differential equation. Kandori, Mailath and 
Rob (1993) study a related discrete-time system. The present paper investi¬ 
gates the stochastic replicator dynamics introduced by Fudenberg and Harris 
(1992). This model is related to that of Foster and Young, but exhibits a 
boundary behavior that appears to be more realistic from a biological per¬ 
spective. Following Fudenberg and Harris (1992), consider the stochastic 
variant of (1.1), 

(1.3) dZj(t) = Zj(t)[{AX(t)}j dt + &j dWj(t)\, j = l,...,n, 

where (W\(t ),..., W n (t)) T = W{t) is an n-dimensional Brownian motion, 
ci,..., a n are positive coefficients and 

X(t) = (X^t), . . . , X n (t)f = + 1 . + Zn(t) (^l(*), ■ ■ • > Z n(t)f. 

The evolution of the population state X(t) is then given by the stochastic 
replicator dynamics 

(1.4) dX(t) = b(X(t)) dt + C{X(t )) dW(t), 
where 

b(x) = [diag(aq,... ,x n ) - xx T ][A - diag(cJi,... ,o£)]x 

and 

C(x) = [diag(xi,..., x n ) - xx T ] diag(<7i,..., a n ) 

for x G A = {y E (0, l) n : yi + • • • + y n = 1}- In many interesting situations, 
the deterministic differential equation (1.2) has a stationary point in A, 
which corresponds to a population state where every pure strategy is present. 
In fact every Nash equilibrium is stationary. On the other hand, the only 
stationary points for the stochastic differential equation (1.4) are the vertices 
of A, corresponding to populations consisting of one common type of players. 

A series of important results on the behavior of the stochastic replicator 
dynamics have been established for the case where the underlying game has 
two pure strategies. For example, Fudenberg and Harris (1992) and Saito 
(1997) examine properties of ergodic distributions, Amir and Berninghaus 



STOCHASTIC REPLICATOR DYNAMICS 


3 


(1998) establish a result on equilibrium selection and Corradi and Sarin 
(2000) provide an asymptotic analysis. However, a large part of the argu¬ 
ments used there is tailored to the case n = 2 and cannot be extended to the 
general case n > 2. This is because when n = 2 one basically deals with one- 
dimensional diffusion processes, and many of the tools available for these 
processes are not applicable to higher-dimensional diffusions, which corre¬ 
spond to games with three or more pure strategies. In particular, in the 
general case, an approach via analyzing a closed form expression of the sta¬ 
tionary distribution is not possible. 

The present paper investigates (1.4) in the general case n > 2. Section 2 
establishes a connection between stable behavior of the processes X(t) and 
the static concept of an evolutionarily stable strategy (ESS), which has been 
introduced by Maynard Smith and Price (1973). Under suitable conditions, 
it is shown that if an ESS exists, then X(t) is recurrent and the stationary 
distribution concentrates mass in a small neighborhood of the ESS. Explicit 
bounds for the expected time to reach that neighborhood are also given. Sec¬ 
tion 3 investigates dominated strategies. It is shown that the probability that 
the frequency of a dominated strategy is above a prescribed level decreases 
exponentially quickly to zero. Interestingly, it turns out that, depending on 
the sizes of the stochastic terms, weakly dominated strategies may become 
extinct in the stochastic model (1.4) even if they survive in the deterministic 
model (1.2). In Section 4 a sufficient condition is derived for a Nash equilib¬ 
rium to be asymptotically stochastically stable. In this connection another 
example emerges which shows that the deterministic model and the stochas¬ 
tic model can lead to quite different predictions: In the Prisoner’s Dilemma, 
the strategy “defect” is a strict Nash equilibrium and becomes predominant 
under (1.2), but may become extinct under (1.4). 

By way of illustration, a discrete variant of the war of attrition is analyzed 
in some detail in the last section. This is a model which describes conflicts 
that are settled by display rather than violence; see Maynard Smith (1982). 
A rather general theorem on the persistence of the maximum effort strategy 
is obtained as a consequence of the results in Section 2. Furthermore, ex¬ 
plicit expressions for ESSs are derived; the ESSs are given in terms of linear 
combinations of Chebyshev polynomials of the second kind evaluated along 
the imaginary axis. This yields a fairly accurate picture of the long-run be¬ 
havior of the stochastic replicator dynamics when the conflicts are modeled 
by a war of attrition. 

Hofbauer and Sigmund [(1998), Section 7.5] show that the deterministic 
replicator equation is, in a sense, equivalent to the deterministic Lotka- 
Volterra equation. The behavior of solutions to this equation under ran¬ 
dom perturbations has recently been investigated by Khasminskii and Kle- 
baner (2001), Klebaner and Liptser (2001) and Skorokhod, Hoppensteadt 
and Salehi [(2002), Section 11], There is almost no overlap with the results 
presented here. 
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2. Stochastic replicator dynamics and evolutionarily stable strategies. 

The concept of a Nash equilibrium is too weak to yield reasonable con¬ 
vergence or stability results for (1.4). A somewhat stronger concept, which 
is of fundamental importance in evolutionary game theory, is that of an evo¬ 
lutionarily stable strategy (ESS), introduced by Maynard Smith and Price 
(1973). The closure A of A is also referred to as the set of mixed strategies. 
A strategy p E A is said to be an ESS if the following two conditions hold: 

(i) p 7 Ap > q r Ap for all q E A, 


and 


(ii) if q / p and p 7 Ap = q r Ap, then p T Aq > q r Aq. 

This static concept lies between that of a Nash and a strict Nash equilibrium, 
and turns out to be particularly relevant to the long-run analysis of (1.4). 

For x E A, let P x denote the probability measure corresponding to the 
process X(t) with initial condition X(0) = x, and let E x denote expectation 
with respect to P x . Note that P x {X(t ) E A for all t > 0} = 1 for all x E A. 
Let P(t, x, G) = P x {X(t) E G } for all Borel subsets G C A. Let tq = inf {t > 
0:X(t) E G}. For <5 > 0, let Ug(pS) = {yE A: ||y — x|| < A}, where || • || denotes 
the Euclidean norm. Let e ? denote the jth unit vector in M n and let 1 E 
M n denote the vector all of whose entries are 1. The mixed strategy ej is 
identified with the pure strategy j. The matrix A is said to be conditionally 
negative definite if 

y r Ay < 0 for all y E M n such that l T y = 0, y / 0. 

Theorem 2.1. Let X(t) be given by the stochastic replicator dynamics 
(1.4) and let p E A be an ESS for the underlying pay-off matrix A. Set A = 
|(A + A T ) ; and let A 2 be the second largest eigenvalue (counting multiplicity) 


of 



n n n 


Then 


( 2 . 1 ) 

Define k > 0 by 


A 2 < 0. 



and suppose that 


( 2 . 2 ) 



n 


\ IA 2 1 min 

V 1 <j<n 
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Then X(t) is recurrent, there exists a unique invariant probability measure it 
on A, and for every initial value x E A, the transition probabilities P(f,x, •) 
converge to i r in total variation. Moreover, for every 5 > k/\J | A 2 1, 

(a) vr{C/ 5 (p)} > 1 --^- 2 , 

(2.3) J A2 If 

^ ^ _ d{x,p) 

(b) ^ xT ^(p)- |A 2 |«5 2 - k 2 ’ 

and for every t> 0, 




where d(x, p) = J2j : Pj >oPj ^°s(Pj/ x j) the Kullback-Leibler distance be¬ 
tween x and p. 

Inequalities (2.1), (2.3)(b) and (2.4) also hold if the ESS p E A, provided 
that A is conditionally negative definite. 


Remark 2.1. The quantity |A 2 1 can be interpreted as a measure of how 
strongly the ESS p attracts X(t) to a neighborhood of p. 

Remark 2.2. Foster and Young (1990) point out that, in view of its lo¬ 
cal character, the ESS condition is not “quite the right concept of dynamical 
stability in a biological context.” It is therefore not surprising that in the 
above theorem the ESS condition is augmented by some additional require¬ 
ment: that k be not too large and that A be conditionally negative definite 
if p E dA. The second condition is easily seen to be satisfied in the examples 
in Section 5. Bapat and Raghavan [(1997), Section 4.1] provide some criteria 
to check whether a given matrix is conditionally negative definite. 

The proof of Theorem 2.1 requires the following auxiliary result. 

Lemma 2.1. Let A E K nxn , n> 2, be a conditionally negative definite 
matrix and let X 2 be the second largest eigenvalue of 

— 1 ___ rp 1 r T—r l^Rl rp 

D :=A --A11 T --11 T A +-^11 , 

n n n z 

where A = ^(A + A T ). Then 

x t Ax 

max —=— = A 2 < 0. 
x T l=0 X-'x 
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Proof. Note first that 

(2.5) x r Z?x = x r ylx for all xGl" such that l 1 x = 0. 


The vector 1 is an eigenvector of D corresponding to the eigenvalue Ai = 0. 
Thus if A is another eigenvalue of D with corresponding eigenvector y, then 
1 7 y = 0. It then follows from (2.5) and the assumption that A is condition¬ 
ally negative definite that 


A 


J T Dy 

T 

y y 


y T Ay 

y T y 


<o. 


Thus Ai = 0 is the largest eigenvalue of D , and the variational description 
of A 2 , the second largest eigenvalue, and (2.5) yield 


, x t T>x 

A 2 = max —=— 
x T l=0 x J x 
x^O 


x T dx 

max —=— < 0. 
x T l=0 X J X 
x^O 


□ 


Proof of Theorem 2.1. Let L denote the second-order differential 
operator associated with X(t), that is, 

(2.0) = + fe* W , 

3 =1 3 3,k= 1 3 L 

where 


bj{x.) = Xj(ej — x.) t [A — diag(<T^,... ,<7^)]x, 

n 

7jfc(x) = 5^c,v(x)c fcl ,(x), 

v=\ 


Cjk(x) 


Xj{l-Xj)aj, j = k , 
- XjX k a k , 


Suppose first that p 6 A, and set p(x) = d(x, p) = '}2jPj^°s(Pj/ x j) for all 
x S A. Then, for all x, g(x) > 0 and 


Lg{*) =~J2Pi( e i - x ) T [ yl - dia g( cr i>---> cr n)] x 


3 =1 


+ \ J2pA - 2x J a j + x l a k 

j= 1 V fc=i > 


= (x - p) T ^4x - 5 5Z x j + 5 H • 
l=i i=i 
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As p is evolutionai'ily stable, (x — p) T Ap < 0. Since p E A, A is conditionally 
negative definite. This follows from the proof of Haigh’s theorem (1975). 
Hence, in view of Lemma 2.1, 

(x - p) T Ax < (x - p) T A(x - p) < A 2 ||x - p|| 2 

and A 2 < 0. The Cauchy-Schwarz inequality gives 1 < (J2j=i x j <7 j) TJj =l a J 2 •> 
so that —Y^ 1 j=i x ‘j (J j < —(H'j=i cr 'j 2 )~ 1 - ^ now follows that 

(2.7) Lg{x) < A 2 ||x — p || 2 + k 2 , xeA. 

Suppose that 5 2 > k 2 /|A 2 |. For every x E A\Us(p), Lg{x) < A 2 6 2 + k 2 , and it 
follows by Ito’s formula that g(X (t)) — (A 2 d 2 + K 2 )t is a local super martingale 
on [0,Tjj , p ,). Hence [cf. proof of Theorem 5.3 in Durrett (1996), page 268] 
s(x) > (|A 2 |<5 2 - K 2 )E x Tjj g(p) , proving (2.3)(b). 

To prove recurrence, consider the transformed process Y(t) = \k(A(f)), 
where T : A —>• R n_1 is defined by T(x) = (\og(x\/x n ),..., log(x n -i/x n )) T . 
One has 


dYj(t) = {(ej - e n ) T M 1 (Y(t)) - \(a 2 - cr 2 )}dt + ctj dWj(t) - a n dW n (t ), 

j = l,-.-,n- 1, 


where \I/ _1 (y) = (1 + e Vl + • ■ • + e yn ~ 1 )~ 1 (e Vl ,... ,e Vn ~ 1 , 1) T . Note that the 
second-order differential operator associated with Y(t) is uniformly elliptic. 
It will next be shown that dU$ 0 has positive distance from <9A for some 5q > 
re/vW. This implies that ^(JJs 0 ) is a compact set. In view of (2.3) (b) it will 
then follow that Y(t) is recurrent [Bhattacharya (1978) and Khas’minskii 
(I960)] and the transition probabilities converge in total variation to the 
unique stationary probability measure [Durrett (1996), Chapter 7]. The same 
applies then to X(t). By (2.2), one may choose do such that k/a/|A 2 | < 5q < 
(n/(n — 1)) mirij pj. Suppose y E M n , X)j=i Uj = I and ||y — p|| = <5o- Let jo 
be such that \y JO — Pj 0 \ = maxi<j< n \yj —pj\, and set 


z = 



Pjo 


Pjo Vjo 
n — 1 


Pjo Pjo 
n — 1 


T 

El” 


One may verify that z is majorized by y — p in the sense of Definition A.l 
in Marshall and Olkin [(1979), page 7], and it follows from Proposition C.l 
in Marshall and Olkin [(1979), page 64] that 


n n / 1 \ 

- Pj) 2 ^J2 z j = ( 1 + Z—J ) - p i°) 2 

j =1 3=1 V 7 

= —-— max (vj — Pi) 2 . 
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Thus, for every j, yj > mini <k<nPk — (n — 1)5 q/u > 0, showing that the 
distance between dUs 0 and <9A is positive. 

For K > g(x) let tk = inf {t > 0 :g(X(t)) = K}. Then, by Dynkin’s for¬ 
mula and (2.7), 


rt/\r K 

0 < E x g(X(t A t k )) = g(x.) + E X Lg(X(s)) ds 

Jo 

rtAf k 

< #(x) + A 2 £ x / \\X(s)-p\\ 2 ds +n 2 Ex(t At k ). 

Jo 


If K —> oo, then t A ffc —► t, and (2.4) follows by the bounded convergence 
theorem. To prove (2.3)(a), let Xjj denote the indicator function of 

Us (p) = A \ U 5 (p). Then, by (2.4), 


n{ - u ‘ <p »=,’i n ci E 4 1 M(P> (x(s)) * 


< lim E k - 

t—>• oo t Jo 


i f ||x(s) - pir . . k- 


5 2 


2 ^2 
- ds < 


|A 2 |5 2 ' 


An inspection of the above arguments shows that if A is conditionally neg¬ 
ative definite, then (2.1), (2.3)(b) and (2.4) hold if the ESS p € <9A. In this 
case, however, X(t) need not be recurrent. □ 


If p is an ESS for A , then there exists a constant c£l such that {Ap} ; = c 
for all j G {1,.. - ,n} with pj > 0; see Hofbauer and Sigmund [(1998), page 
63]. Thus 

[diag(pi,... ,p n ) - pp^Ap = 0, 

so that the drift vector b(x) of the stochastic differential equation (1.4) will 
in general not be zero at x = p. If, however, p is an ESS for the modified 
pay-off matrix B = A — diag(<Ti,..., cr 2 ), then b(p) = 0. From this point of 
view it is more natural to investigate the distance between X(t) and an ESS 
for B. A simple modification of the proof of Theorem 2.1 yields the following 
result. The analogous results on recurrence and the stationary distribution 
are omitted for brevity. 


Theorem 2.2. Let X(t) be given by the stochastic replicator dynamics 
(1.4) with underlying pay-off matrix A. Let p£ A be an ESS for the modified 
pay-off matrix A — diag(cr 2 ,..., <r 2 ). Suppose also that A — diag(^cr 2 ,..., ^<r 2 ) 
is conditionally negative definite. Then for every initial state x£ A and 
every t> 0, 

(2.8) E xfif o ll^(s) ~p|| 2 rfa< 
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where d(x,p) = J2j: Pj >oPj ^°&(Pj/ x j) an d ^2 second largest eigenvalue 

of 

— 1 — rr 1 rp \ T ~A1 rp 

A --A11 t - -11 t A + —^11 T , 
n n n 2 

where A = |[A + A T — diag(crf,..., cr^)]. 

Remark 2.3. If the ESS p E A, it follows that A — diag((T^,... ,a 2 ) is 
conditionally negative definite, so that in this case, the assumption that 
A — diag(^of, ..., \(Tp) should be conditionally negative definite is not very 
restrictive. To compare (2.4) and (2.8) note that |A 2 1 > |A 2 1 and 

1 XX 1 j ^ 9 1 -2 + \ 

2 3=1 1 ^3 = 1 °3 1 3=1 

3. Extinction of dominated strategies. This section is concerned with 
the evolution of strategies that are inferior to other strategies in the sense 
of domination. 

A strategy p E A is said to be weakly dominated by strategy q E A if 
p r Ar < q r Ar for all r E A 

with strict inequality for some r. If the inequality is strict for all r, then p 
is said to be strictly dominated by q. 

For the deterministic replicator dynamics (1.2), Akin (1980) has shown 
that strictly dominated pure strategies become extinct; more precisely, their 
frequencies in the population converge to zero. Theorem 3.1 establishes that 
under the stochastic replicator dynamics (1.4) even pure strategies that are 
only weakly dominated become extinct under a suitable condition on the 
diffusion coefficients ay,..., a n . Theorem 3.1 also gives an upper bound for 
the probability that at a given point of time t the frequency of a dominated 
strategy is above a prescribed value e > 0. The bound converges exponen¬ 
tially quickly to zero as t —> 00 . 

Theorem 3.1. Let X(t) he given by (1.4). Suppose that the pure strategy 
k is weakly dominated by some mixed strategy p E A. Set c\ = min qe ^p T Aq — 
e^Aq and suppose that <xi ,,cr n are such that 

rr 2 1 n 

(3-1) c 2 = -y + 2^ Pi(T)2<Cl ' 

3=1 

Then for every initial state x E A, 

P^{X k {t) = o(exp[-(ci - c 2 )t + 3 a max Vt loglogf])} = 1, 
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and for 0 < e < 1 and t> 0, 

r*iw) > s} < i - »( C3(x>+log£ + i ci ~ C2)t }, 

I ^maxV 4 t J 

where 3>(v) is the normal distribution function, cr max = rnax{<7i,..., a n } and 
C3(x) = T,]=lPjiog(Xj/x k ). 


Proof. Let H(t) = logX k (t) — Y0j=iPj log Xj(t) for t > 0. Then, by Ito’s 
formula, 


r t i n 

H(t ) = H{ 0) + / elAX(s) - p T AX{s )+ 

Jo 2 2 J= i 


,(t| ds 


+ 0fcW fc (i) - 

3 =1 

< H(0) + (c 2 - ci)t + <7 IT(i), 

where d = [(1 - Pfc) 2 ^, + ^y fc ^cr|] 1/2 and W(t) = [cr fc P4(t) - Ej=iPj&j x 
W J (f)]/d is a standard Brownian motion. Clearly, a < \/2fr ma . y . It follows 
that P x -almost surely, 

lim supXfc(t) exp[(ci - c 2 )t - 3a max y/t log log f] 

t—>oc 

< lim sup exp [H(t) + (ci - c 2 )t - 3cr max \/t log log i ] 

t—>oo 

< limsupexp[—c 3 (x) + &W(t) — 3(j max \/i log log t ] = 0 

t—KX) 

by the law of the iterated logarithm. Moreover, 


P x {X k (t) >e}< P x {H(t) > logs} 

<Px{-C3(x) + (c 2 -ci)f+ dIT(t) > loge} 
o 3 (x) T log £ T (ci - c 2 )t\ 


< 1 - <f> 


0V, 


t \/2£ 




□ 


Remark 3.1. Condition (3.1) is always satisfied if k is strictly dom¬ 
inated by p and (j\ = • • ■ = a n . The condition is also satisfied when k is 
merely weakly dominated and a k > aj for every j k. Thus if the diffusion 
coefficient corresponding to a weakly dominated strategy is large enough, 
its frequency converges to zero. This behavior is different from the behavior 
of weakly dominated strategies under the deterministic replicator dynam¬ 
ics where weakly dominated strategies may well persist with any prescribed 
positive population share; see Weibull [(1995), Example 3.4, page 84], This 
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difference between the deterministic and the stochastic population dynamics 
agrees with the findings of Alvarez (2000) which show that, under mild con¬ 
ditions, “increased stochastic fluctuations decrease the expected population 
density.” Cabrales (2000) proves that in a similar stochastic model itera¬ 
tively strictly dominated strategies become rare, provided stochastic effects 
are sufficiently small. 

Remark 3.2. In the situation of Theorem 3.1, 



1 — $(v) < exp(— u 2 /2), v > 0. 

Remark 3.3. The assumptions of Theorem 3.1 may be satisfied even 
if the pure strategy k is not dominated by any other pure strategy. For 
example, let 



Then the pure strategy 1 is strictly dominated by p = (0, i, i) T and, accord¬ 
ing to Theorem 3.1, X\(t) —> 0 almost surely, even though neither strategy 
2 nor strategy 3 dominates strategy 1. 

4. Stochastic stability of Nash equilibria. The last section dealt with the 
extinction of pure strategies that were inferior to at least one strategy. The 
present section investigates strategies that can be regarded as being locally 
superior to all other strategies. The relevant concept is that of a strict Nash 
equilibrium. 

A strategy p E A is called a Nash equilibrium if 


p T Ap > q r Ap for all q € A. 


If the inequality is strict for all q ^ p, then p is a strict Nash equilibrium. 

In other words, a Nash equilibrium is a best reply to itself, and a strict 
Nash equilibrium is the unique best reply to itself. Only pure strategies can 
be strict Nash equilibria; see Weibull [(1995), page 15]. Thus if nearly the 
whole population plays a strict Nash equilibrium, then the highest pay-off is 
obtained by exactly that strategy so that natural selection would not favor 
any other strategy. This suggests that a strict Nash equilibrium should be 
an asymptotically stable state, which is indeed the case under the determin¬ 
istic replicator dynamics (1.2). This need not be the case for the stochastic 
replicator dynamics (1.4), as is illustrated by the following example. 
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Example. Consider the Prisoner’s Dilemma game [Hofbauer and Sig¬ 
mund (1998), page 101] with two pure strategies: 1 = co-operate, 2 = defect, 
and pay-off matrix 

. (an a 12 \ 

A — , 021 > Oil > 022 > 012- 

V °21 a 22 ) 

Here strategy 2 is a strict Nash equilibrium and under (1.2), lim^oo £2 (t) = 1 
for all initial states £(0) E A. On the other hand, if 

a 2 a l t i 

— > — + max{a 2 i - 011,022 - ai 2 j, 

then condition (3.1) of Theorem 3.1 is satisfied with k = 2, p = (1,0) T , 
so that Pxjlimj^oo X\{t) = 1} for all x E A. This is a reasonable behavior, 
because if all players co-operate, then the received pay-off, an, is larger than 
022 , the pay-off they receive when all players defect. Thus the stochastic 
model may explain the spread of co-operative behavior, which could not be 
observed in the deterministic model. This fact agrees with results of Nowak, 
Sasaki, Taylor and Fudenberg (2004) who study a discrete-time Markov 
chain to explain the emergence of co-operation in a finite population that 
plays the Prisoner’s Dilemma game. 

The next theorem gives a sufficient condition for a strict Nash equilibrium 
to be asymptotically stochastically stable. Notice that a pure strategy k is 
a strict Nash equilibrium if and only if a kk > a ]k for all j 7 ^ k. 

Theorem 4.1. Let X(t) be given by (1.4). Let k be a strict Nash equi¬ 
librium. Suppose that a k is so small that 

(4.1) a k k > a jk + crl forallj^k. 

Then is asymptotically stochastically stable. That is, for any neighborhood 
U of e k and for any e > 0 there is a neighborhood V of such that 

P x { X(t) E U for all t > 0, lim X(t) =e k 1 > 1 — e 

( t —>00 J 

for every initial state x E V n A. 

Proof. The proof is an application of the stochastic Lyapunov method. 
Consider the Lyapunov function (f>(y) = 1 — y k - Evidently, (j>(y) > 0 for all 
y E A with equality if and only if y = e k . It will be shown that there is a 
constant c > 0 and a neighborhood Vq of e k such that 


(4.2) 


L<t>{y) < y) for all y E V 0 C A, 
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where L is the differential operator given by (2.6). The assertion then follows 
from Theorem 4 and Remark 2 in Gichman and Skorochod [(1971), pages 
314 and 315]. Write B = A — diag(of,..., a^)- For all y G A, 

L(/>(y) = — 2/fe (e fc - y) T By 

2 /fc 'y ' y/ib^ul/u Vk{ 1 Vk) y ' b kl/ y v 

fi^k v^k 

Vk ] — (1 — Vk)bkk H - ^ ^ Ufi^iik 

v f.i^k 

Let (5 = max{| 6 Mi ,|: //, v = 1,...,n}. Then 

y 1 T /3 y ] y^ y ] y v 1(1 y k ) , y ] b ku y v < /3(1 2/fc)- 

fi^k fiy^k v^k v^k 

n^k 

Moreover, condition (4.1) ensures that for some 
so that 

(i yk)bkk T ) ] y^b/ik — (f yk)bkk t (^/cfc 

^k 

Hence 

L<t>{y) < 2(3y k {l - y k f - ay 2 k { 1 - y k ) = -y k {(a + 2(3)y k - 2(3}<j)(y), 
which proves (4.2) with Vo = {y £ A : y k > | a +20 } an d c = f • C 

Remark 4.1. Condition (4.1) means that k is a strict Nash equilibrium 
with respect to the modified pay-off matrix B. If k is only a neutrally stable 
strategy with respect to B [see Weibull (1995), Definition 2.4, page 46], 
then, by Proposition 2.7 of Weibull [(1995), page 48], Lcj>{ y) = —y k (e k ~ 
y) T By < 0 for all y in a certain neighborhood of e k . Hence in this case 
Theorem 4 of Gichman and Skorochod [(1971), page 314] yields that e k is 
still stochastically stable. 

Theorem 4.1 says that if the population is in a state sufficiently near to a 
strict Nash equilibrium e k , then, with probability close to 1, that equilibrium 
will actually be selected by the stochastic replicator dynamics in the sense 
that linit_ KX) X(t) = e k . If there are several strict Nash equilibria and the 
initial state is not close to any of them, it is neither clear which one will be 
selected nor in fact if any will be selected at all. The next theorem establishes 
that when the underlying game is a coordination game, that is, every pure 
stategy is a strict Nash equilibrium, then it is almost certain that one of the 
equilibria will be selected. 


a > 0, b^ k < b kk — a for all 

-ot)^2y^ = -a{l-y k ). 
v¥=k 
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Theorem 4.2. Let A be the pay-off matrix of a co-ordination game and 
let X(t) be given by (1.4). Suppose that, for every k, a k is so small that 
akk > ajk + erf. for all j / fc. Then, for every initial state x e A, 


lim X(t) = for some k > = 1. 
[t —>oo J 


The proof hinges on the following theorem, which is of interest in its own 
right. It states that for any underlying game, X(t) will come arbitrarily close 
to one of the points ei,... ,e n in finite time. 

Theorem 4.3. Let A be an arbitrary pay-off matrix, let X(t) be given 
by (1.4) and let x S A. Let e > 0. Consider the hitting time 

t s = inf{t > 0: X k (t) > 1 — £ for some k G {1, ..., n}}. 

Then E x t £ < oo. Moreover, 

P x (sup max{Xi(f),..., X n (t)} = ll = 1. 

U>o J 


Proof. For a > 0 and y £ A define 

n 

M y) = <Ky) = ne a -J2 e0iyk - 

k =1 

Let B = A — diag(cr^,..., a 2 ) and let L be given by (2.6). Then 

2 n 


y) = -a 51 yk( e k ~ y) T By e ayk - — ^ y\ < < 7*(1 - y k f + ^ cr 2 y 2 


t 2 7, 2 l o a Vk 


k =1 




k =1 

Let /3 > 0 be such that 

|(efc — y) T l?y| < /3 for all y € A and k € {1, ... ,n}. 

Let o"min = minjci ,... ,a n }. Then 

n ( 2 ^ 

m y) <aJ2vke ayk \p - ^=:%(1 - 2/ fc ) 2 . 

fe=i ^ 1 J 

Let a > 0 be so large that 




— y) 2 > n/3 + 1 for all y € 


1 - e 


n 
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Suppose that y E A is such that y*, < 1 — e for all k = 1 ,n. Then there 
is at least one y*, in [A, 1 — e], and so 


L<t>(y) < a(3 Vke ayk +a ^ y k e ayk {-(n - l)f3 - 1} 

k:y k <l/n k: y k &[l/n,l-e) 


pOi/n pOi/n 

< a(3(n — 1)- h a -{—(n — 1 )/3 — 1} 

n n 


0 a/n 


< -a- 


n 


Thus, by Dynkin’s formula, for every T < oo, 


rr e AT 

o < E x <P{X(t £ A T)} = 0(x) + E x / L(j){X{s )) ds 

Jo 

e a/n 

< ne a — a - E x {t £ A T ). 

n 

Letting T —+ oo, one obtains by monotone convergence that E x r e < n 2 e a j a < 


oo. 


Choosing e = 1/m, one obtains in particular that 

P-x.\ supmax{Xi (t),.. .,X n (t)} > 1-} = 1 

U>o rn) 

for every m E N. Hence 

P* \ sup max{ Ai (t),..., X n (t)} = l) 

U>o ) 

= p x{ n | su Pmax{Ai(t),... ,X n (t)} > 1 - —) 1 = 1. 


□ 


Proof of Theorem 4.2. Let e > 0 and suppose that akk > cijk + u/ 
for all j, k = 1,..., n with j ^ k. Then, for every k, there exists, by Theorem 
4.1, some 5k > 0 such that 

PA lim X(t) = e fc l > 1 - e if > 1 - 5 k - 

(y—>oo J 

Set r = inf{t > 0: Xk(t) > 1 — 5k for some k} and F = {lirn^oo X(t) = e*. forsome k}. 
Let xf denote the indicator function of F. According to Theorem 4.3, r is 
P x -almost surely finite, and so, by the strong Markov property of Ito diffu¬ 
sions, 

P X (F) = E x E x{t) xf > 1 - £■ 

As e > 0 was arbitrary, the assertion follows. □ 
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5. A discrete war of attrition. Theorems 2.1 and 2.2 show that an ESS, 
if it exists, gives precise information about the long-run behavior of the 
stochastic replicator dynamics. In this section explicit expressions are de¬ 
rived for ESSs for a discrete variant of the war of attrition, introduced by 
Maynard Smith and Price (1973). See Maynard Smith (1982) and Bishop 
and Cannings (1978) for a detailed discussion and extensions. 

In the discrete symmetric war of attrition each player selects a pure strat¬ 
egy j G {0, 1,... ,n}, which determines the maximum length of time, Cj, the 
player is willing to display for. The contest progresses until one of the players 
has reached his chosen limit; this player leaves and the other player obtains 
a reward. The value of the reward is constant or a decreasing function of 
the length of the contest. Both players incur a cost given by the length of 
the contest. If both players have chosen the same length of time, the reward 
is shared. 


Specifically, the pay-off matrix A = (aj k )■ 

o 

II 

..., n, is given by 



f ^ k Qc) 

j >k, 


(5.1) 

a jk = S 

| v k 

1 2 Cfc ’ 

j = k, 



1 


j <k, 


where 






0 < cq < ci < ■ • ■ < c n and vq 

>«!>■■ 

■ > v n > (1. 


The corresponding stochastic replicator dynamics is 

(5.2) dX(t) = b (X(t)) dt + C(X(t )) dW(t), 

where W[t) denotes an (n + l)-dimensional Brownian motion and, for x = 
(x 0 ,...,x n ) T , 

b(x) = [diag(x 0 , • • •, x n ) - xx 1 ][A - diag(cTo,... ,cr^)]x 

and 

C(x) = [diag(x 0 ,..., x n ) - xx 3 ] diag(cr 0 ,..., a n ). 

Theorem 2.2 suggests to consider ESSs not only of A but also of the 
modified pay-off matrix B = (bj k ), j, k = 0,..., n, with 


(5.3) 

II 

-se 

{ Vk - Cfc, 

| v k 

| r> Cfc Pk, 

II V 



{ ~ C B 

j <k, 

and 




0 < cq < ci < • 

^ C-rn 

Al 

Al 

o 

■>v n >0 


The following lemma ensures that the pay-off matrices A and B satisfy 
the assumptions in Theorems 2.1 and 2.2. The proof is in the Appendix. 
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Lemma 5.1. For the war of attrition with pay-off matrix given by (5.1) or (5.3) 
there exists a unique ESS, and the pay-off matrix is conditionally negative 
definite. 

The next theorem is a basic persistence result for the replicator dynamics, 
saying that with probability close to 1 the maximum effort strategy, that 
is, strategy n, will not die out. For j = 0,... ,n, let ej denote the (j + l)st 
column of the unit matrix of order n + 1. 


Theorem 5.1. Let X(t ) be given by the stochastic replicator dynamics 
(5.2) with initial state x e A. Let e > 0. Then there exists a* = cr*{e) > 0 
such that 

P x j lirnsup X n (t) > ol > 1 — £, 

l t—> OO J 

provided that <ro,..., cr n < a*. 

Proof. Let p be the ESS for A. It will first be shown that p n > 0. 
Suppose that this is not the case, so that m := max{j :pj > 0} < n. Then 
e^ +1 Ap < e^Ap, see Hofbauer and Sigmund [(1998), page 63]. As pj = 0 
for j > m , 


m— 1 


Up = H (vj ~ cj)pj + U 1 ~ 


i=o 

m 


Pm: 


Thus 


e m+l Ap = J2( v i - c j)Pj- 
1=0 


0 < e? n Ap - e^ +1 Ap = — ^p m < 0; 


a contradiction. Hence p n > 0. 

By Theorem 2.1 and Lemma 5.1, for all t > 0, 


ff‘\Xn[s)-p n \ 2 is< pL{ 


1 j d(x, p) 1 ^ 2 I 

0 =1 > 


where A 2 / 0 depends only on A. Choose to > 0 and cr* > 0 such that 


d(x, p) ^ pie {cr*) 2 - 2 


IA 2 |^o 16 


IA 21 8 


Thus if do,..., a n < a *, then 
1 




[ \X n {s) - p n \ 2 ds < ^ for all t> t 0 - 
JO 8 


t 
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Now consider the increasing sequence of events 

Ffj, = jx„(s) < y for all s>t 0 + /r|, /r = 1,2,.... 
For every //, 


V n £ > 1 


r r 2 (t 0 +u) 

/ / I x n (s) - p n I 2 ds dP x > ^Px(P M ), 

JF u JtQ-\-Ll o 


8 2(to + p) . IF^ J to +// 

so that P X (U“=1 P/i) < s. Hence 


Px | lino, sup X n (t) > o| > P x y Q F^J > 1 - 


□ 


In general the ESS for a discrete war of attrition may have a fairly compli¬ 
cated structure. Cressman [(2003), Section 7.4] describes a broad approach 
to calculating ESSs for these games using backward induction. Whittaker 
(1996) has recently solved several closely related resource allocation prob¬ 
lems based on a multiple trial war of attrition. The following theorem gives 
an explicit expression for the ESS in the case where the and the v/. are 
constant and Cj =j for all strategies j. Combining Lemma 5.1 and Theo¬ 
rems 2.1, 2.2 and 5.2, one obtains a fairly complete picture of the long-run 
behavior of the stochastic replicator dynamics when the conflicts are mod¬ 
eled by a war of attrition. 

Let U m (x) denote the mth Chebyshev polynomial of the second kind, and 
let U-i(x) = 0. Let i = t/— 1 . 


Theorem 5.2. Consider the war of attrition with pay-off matrix B = 
(bjk), j,k = 0 ,...,n, where 

! v-k, j> k, 

V 

2 ~k~p, j = k, 

~j, j < k, 

and 0 < p <\v. The unique ESS p is given as follows. If the reward v is so 
large that v > 2 n + 2 p, then 

P0 = ■■■= Pn-l = 0, p n = L 

Otherwise there is a unique index s £ {0,..., n — 1} such that 

v 

(5.5) n — l+p<- + s<n + p, 
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and 


(5.6) 


and 


If v 


Pk = 


c 2 


x \ u s _ k+ 1 + (s + l- n+ - + p] u s -k 


+ (s + l-n)Q + /0^ s _fc-i|, 0 <k<s, 


(5.7) Pk = 0, s+l<k<n— 1, 
1 / u x S+1 


where 


Pn = - C [~2- P 


Uk = (~il) k U k [- 


( *(2p+l)\ 

[ 

V 2 7 J’ 

7= V' 


c = -u s+ 2 + (n — s — 1 — 2p)zi s+ i + {2p(n - s - 1) + 7 2 }u s 


- (n - s - l) 7 2 n s _ 


i- 


The proof of this theorem requires some auxiliary results, which are proved 
in the Appendix. 

It was shown in the proof of Theorem 5.1 that for the war of attrition 
(5.3), strategy n is always contained in the support of the ESS. The next 
lemma states that for j < n, strategy j can belong to the support only if 
the corresponding cost Cj is below a certain threshold. This is the discrete 
analogue of Theorem 7 of Bishop and Cannings (1978). The lemma explains 
in particular the choice of s in Theorem 5.2. 


Lemma 5.2. Let p be the ESS for the war of attrition with pay-off matrix 
B = ( bjk), j, k = 0,..., n, described by (5.3). If j < n and Cj > c n + p n — \v n , 
then Pj = 0. 


The next two lemmas give explicit formulas for determinants related to 
the pay-off matrix of a war of attrition. Let J k denote the k x k matrix with 
all entries equal to 1 and let \ k denote the k x 1 vector all of whose entries 
are 1. 

Lemma 5.3. Lei 5 G R( re+1 ) x ( n+1 ) be given by (5.3). For k = 0, ... ,n, 
let Bdenote the matrix obtained from B by replacing column k with the 
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vector l n +i- Then 



Pi 


and, for k = 0,..., n — 1, 


(let B (k> = det(B n _k 


k—i / 

T CkJ n —k) | ( 
1=0 v 



where B n _is the (n — k) x (n — k) principal submatrix of B situated in the 
bottom right-hand corner. 


Lemma 5.4. Let B e j£hH-i)x(n+i) be given by (5.4) with 0 < p < ^ v. Set 
7 = \/j v ' 2 ~ P 2 ■ Then 


detB= Q 7) n 1 


x < -i'yUnl - 


i(2p + 1) 
2 7 




Proof of Theorem 5.2. Let B be given by (5.4). Suppose first that 
v >2n + 2p. Then j > n + p — \v for every j = 0,..., n — 1. Thus if p is the 
ESS, then, by Lemma 5.2, pj = 0 for j = 0,..., n — 1, so that p = e n . 

Suppose next that 2p < v < 2n + 2p. Define s E {0,..., n — 1} by (5.5) and 
define p € M n+1 by (5.6), (5.7) and (5.8). It will be shown that 

(5.8) {Bp}j = {Bp} n if 0 <j<s, 

(5.9) {Bp}j<{Bp} n if s + 1 < j < n — 1. 

It will also be shown that p£ A. Since, by Lemma 5.1, any principal subma¬ 
trix of B is conditionally negative definite, it will then follow from Haigh’s 
(1975) theorem that p is the ESS. 

For m = 0,..., n set 


B 


m 


According to Lemma 5.4, 


b oo • • • from 

frmO • • • fr mm 


(5.10) 


det B m 




G + pK-‘}' 
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Set 



boo ■ 

• fro s 

frOn 


< Po\ 

B = 

b s o • 

frss 

frsn 

and p = 

Ps 


. b n 0 

frns 

frnn. 


\Pn) 


For k = 0,..., s + 1 let B denote the matrix obtained from B by replacing 
column k with the vector l s + 2 - As p k = 0 for s + 1 <k <n — 1, 

(5.11) {Bp}j = {Bp}j, 0 <j<s, {Bp} s+ i = {Bp} n . 

The matrix B is again of the form (5.3). It follows from Lemma 5.3 that for 
every k < s — 1, 


det B {k) = 


v 

2 


v 

2 


det 


9fc+i,fc+i 


+ k 


bk+l ,s + k &fc+l,n + k 


x det 


-P- 1 
v — 1 

v — 1 
v — 1 


^n,fc+l A ^ 


-1 

-p-2 

v-2 

v-2 


b s .s T ^ 


-1 

-2 


u s,n 

-'n,n 


+ k 
+ k 


-1 

-2 


— p — (s — k) — (s — k) 

v 

v — (s — k) — — p — (n — k) 


Denote the matrix in the previous line by Q. To calculate detQ augment 
Q from the left by the (s — k + 1) x 1 vector (v ,..., v) T and put on top of 
the matrix thus obtained the 1 x (s — k + 2) vector (^u — p, 0,..., 0). This 
gives a matrix which is equal to B s _ k+ \ except for the element in the lower 
right-hand corner, which is — p — n + k, while the corresponding element 
of B s _ k _ |_i is \v — p — s + k — 1. Hence 

det Q = 


(^ - p] det 

- V 

2 — P Oix(s—fc+i) 

\2 ) 

fc+i Q 


2~ P 


-i 


{det B s _ k+l - (n-s- 1)det B s _ k }, 


and so, by (5.10), 

det B^ = (---p 


'U , s—k+l H” I 0 + P V's—k 
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-( n-s- 1 )\u s _ k + ( - + p)u s -k -1 


= cpk, 

—(s) 

provided k < s — 1. Similarly, detB = cp s , and it follows directly from 
Lemma 5.3 that 


det B {s+1) 


Thus 

(5.12) 


v \ s+1 
2 ~ p ) =cPn ‘ 


( det B (0) 


cp = 


VdetB ( ' +1) . 

Let adjB denote the adjugate matrix of B. It is readily verified that 

_ ( det B (0) 

(5.13) (adj B )l<j +2 = 


and therefore 


\detB (s+1) 


Bp = -B(adj B)1 s+2 = dCt ^ ls+ 2 - 
c c 


In view of (5.11) this proves the first claim (5.8). 
If s < j < n, then, by (5.5), 


bjn = ~j < ~s - 1 < - - n - p = b r 


and so 


{ B p } j — ^ ) bjkPk T bj n p n — ^ + bj n p n ' 'z ) bni-pp. T b nn p n — {Bp}n, 

k= 0 k= 0 k= 0 

proving the second claim (5.9). 

Finally, to show that p E A set 


tj=Uj + (s + l-n+ l - + p^Uj-i + (s + 1 - n) ^ + p'jUj - 2 , 

so that the first s + 1 entries of p can be written as 

k 


3 = 1 , 2 ,. 


1 ( v 

Pk = — P ) ''s—k+l i 


0 < k < S. 
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In view of (5.5), 

v 

ii = - — p — n + s <0, 

t2 = (I +p ) (i _ p ~ n +s+ 1) - ( 2p+1 ^ 1 > °' 

Using the recurrence relation for the Chebyshev polynomials [Szego (1975), 
equation (4.7.17), page 81] one may verify that 

u k = -(2p + l)u k -i + 7 2 u fc _ 2 , k> 1. 

Therefore, 

= -(2p+ l)4-i +7 2 4-2, A: >3. 

It now follows by induction that (—1 ) k tk > 0 for all k. A short calculation 
shows that c = —t s+2 + (|u — p)t s+ 1 , so that (—l) s+1 c > 0. (In particular, 
c / 0, which has hitherto been tacitly assumed.) It is thus obvious that 
Pk > 0 for 0 < k < n. 

To verify that J2k=oPk = 1 note that by (5.7), (5.12) and (5.13), 

n s 1 

J2pk=Pn + J2pk = - lf+ 2 (adj B ) l s+2 . 
k =0 k =0 C 

By a well-known determinantal formula for partitioned matrices [Gant- 
macher (1959), page 46], 

l;f + 2 (adj B)l s+2 = det B- det (B - l s+2 lJ +2 ). 

Observing that, by (5.10), 


det B = det B s+ \ — (n — s — 1) det B s 


u s+ 1 + (- + p)u s - (n-s-lKu s + ( - + p)u s -1 


and 


-1 


det (B - l s+2 l s+2 ) = - - p) {det B s+2 - (n - s - 1) det B s+1 } 


= u s+2 + + pju s+1 - ( n-s - l)|u s+ i + Q + p^)u s |, 


one obtains that lj +2 (adj B )l s+2 = c, so that J2k=oPk = 1- C 
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APPENDIX 

Proof of Lemma 5.1. As q 2 B q = q T Aq — Y?j= o QjPj < q r Aq for all 
q E M n+1 , it suffices to show that A is conditionally negative definite. Define 
the n x n matrix D by djk = \{bjk + bkj) — h/o — &ofc + boo, j,k = 1,... ,n. 
Thus 


djk Dnin{j,fc} ^0 T 2cq. 

For k = 1,..., n let be the n x 1 vector whose first k — 1 entries are 0 and 
whose remaining entries are 1. Then D can be written as 

n 

D = J2( v k - v k -1 - 2(Cfc - C fc _i))f A .fJ, 
fc=l 

showing that D is negative definite. This implies that A is conditionally 
negative definite; see Haigh (1975). 

The existence of an ESS now follows, since in a game with conditionally 
negative definite pay-off matrix, a Nash equilibrium, which always exists, 
must be an ESS. To prove uniqueness suppose p and q are ESSs. Then 
p T Bp > q T Bp and q r L?q > p 1 B q, so that (p — q) T S(p — q) > 0. Since B 
is conditionally negative definite, this implies p = q. □ 


Proof of Lemma 5.2. The assertion is obviously true if pj = 0 for all 
j < n, so assume pj > 0 for some j < n. Let m := max{j :j<n, Pj> 0}. 
Then p m > 0 and, as in the proof of Theorem 5.1, p n > 0, so that e„Bp = 
e I 5 P. see Hofbauer and Sigmund [(1998), page 63]. Since pj = 0 if m + 1 < 
j<n- 1, 


m— 1 


e m B P =J2( Vk ~ Ck ^>Pk + 


k =0 

m 


Cm Pm j Pm C-mPn •> 


e n B V =J2( Vk ~ Ck ^ k + ( ~ Cn ~ P n )Pn- 

k =0 


Thus 


0 = el Bp- e^Bp = 


T Pm jPm T I C n p n + C m j pni 


and it follows that v n /2 — c n — p n + c m < 0. That is, c n + p n — v n /2 > c m . 
Now suppose that j < n and Cj > c n + p n — v n /2. Then Cj > c m , and since 
the sequence (c M ) is increasing, j > m. Thus Pj = 0. □ 


Proof of Lemma 5.3. Suppose 1 < k < n — 1. For j = 0,..., k — 1, 
add Vj — Cj times column k of B^ k \ that is, the vector l n +i, to column j. 
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For j = k + 1,... ,n, add Ck times column k to column j. The matrix thus 
obtained can be partitioned as 

D l k * 

010 

.0 In—fc B n _k + CkJ n -k_ 

where D is a k x k upper triangular matrix with diagonal elements —vq/2 — 
po,..., —Vk-i/2 — Pk-i- The assertion is now obvious. The proof is similar 
for k = 0 and k = n. □ 

Lemma A.l. Let 71 , 72 ,® € M, 71,72 > 0. The determinant of the n x n 
tridiagonal matrix 


X 

7i 

0 

0 ... 

0 

0 

0 ■ 

-72 

X 

7i 

0 ... 

0 

0 

0 

0 

-72 

X 

7i ••• 

0 

0 

0 

0 

0 

0 

0 ... 

-72 

X 

7i 

. 0 

0 

0 

0 ... 

0 

-72 

x . 


is given by 

(A.l) det D n (x) = i n ('yij 2 ) n/2 Un(^- 

Proof. Note first that 

detDi(x) = x, det D 2 (x) = x 2 + 7172 . 

Expanding det D n (x) along the last column, one obtains that, for n > 2, 
det D n (x) = x det D n ~i(x) + 7172 det H n _ 2 (®). 

Denote the expression on the right-hand side of (A.l) by h n (x). Then 
hi(x) = x, h 2 {x) = x 2 + 7 r 72 , 

and, by the recurrence formula for the Chebyshev polynomials [Szego (1975), 
(4.7.17), page 81], for n > 2, 

= xh n -i(x) +7l7 2 /ln-2(®)- 
Now the assertion follows by induction. □ 
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Proof of Lemma 5.4. Define the n x n matrices F and G by 
■ v 


F = 


2~ P 

v 

v 


2~ P 



'-1 

-1 

-1 .. 

. -1 


-1 

-2 

-2 .. 

. -2 

G = 

-1 

-2 

-3 .. 

. -3 


-1 

-2 

-3 .. 

—n 


Let I denote the n x n unit matrix. Then 


det B = Q -p^j det (F + G) = Q - p^j detGdet^- 1 ^ +/). 


It is easily seen that detG= (—l) n . Moreover, 

-2 1 


G~ l = 


1 -2 1 
1 -2 1 


1 -2 1 
1 -1 


so that 


G~ l F + I = 


V 

2p + l --p 

v v 

---f 2p+i --p 


-- - p 2/9+1 - — p 


~2~ p 2p+1 


2~ P 


v v 

— p —- + P + 1 


It now follows by Lemma A.l that 
detS=Q-p)(-l)"{i" 7 "C/ n (- 


i{2p + 1) \ 
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= ( -nr{(f-p)t4>(- 


i(2p + 1) 

2 7 


+ i'yUn-l - 


i(2p+l) 

2 7 


□ 
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